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[571 ABSTRACT 

A high-resolution vision system comprising remotely 



positioned image-sensing means, such as a TV camera, 
and a head-moimted display that is used by an observer 
to view the image picked up by the remote sensors. 
Both the sensing means and the display are servo con- 
trolled to follow the eye line-of-sigl\t (LOS) of the 
observer. The eye LOS is chaiacterized by the eye 
angle of the observer with respect to his head plus the 
head angle with respect to a reference axis, such as the 
center line of an aircraft. Because the display follows 
eye motion by means of a servoed mirror or beamsplit- 
ter in front of the eye, the eye always looks at a fixed 
point on the display. The resolution of the display pref- 
erably is increased on the LOS so that the display char- 
acteristics closely match the eye. i.e., high resolution 
on the eye LOS and lower resolution in the peripheral 
region. This preferably is accomplished by using dual 
sensing means, such as dual TV cameras, one v/ith a 
wide and the other with a narrow field of view. The 
output fit)m these sensing means is processed by head- 
mounted cathode ray tubes, then opticaDy combined 
with preferably a 1:1 magnification, and projected into 
the eye by means of the servoed beamsplitter. In a 
further embodiment of the invention, the sensing 
means can be a computer, resulting in optical images 
that appear fixed in space. Alternately, the computer- 
generated images can follow head motion. 



10 Claims, 11 Drawfaig Figures 
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Admittedly, prior art apparatus have provided servo- 
HIGH-RESOLUnON VISION SYSTEM controlled means sensitive to cither head or to eye 

movement for controlling various devices such as 
BACKGROUND OF THE INVENTION weapons relative to a line of sight, but there is no sfcow- 

1. Fiddofthclnvention 5 rng in the prior art in which both head and eye tracking 
The present invention relates to high-resolution vi- techniques have been combined to realize the en- 

sion systems and more particularly, to a hehnet- hanced performance of the apparatus embodied m the 
mounted display system in which remotely located subject invention. Prior art showings of head-trackmg 
sensors controlled by head and eye trackmg means techniques include U.S. Pat- Nos.: R- Bro^n 
generate signals that are transmitted to sigmd-process- 10 (2,312,954); L. p. DorKttc ( 3,824,304); H.^ Wag- 
ing means on the hehnet to produce a display image ner etal. (^..^^^.S^^);" L. St^piroet^. (3^62210); 
having a wide field of view whh an area of high resolu- "ft'^'^. f <^'^^°'^^A^i;.hfl7; 
tion that is mamtained on the operator's line of sight (3,633.988); M.H Freeing ^^if^'^I'^' ^ 

McKechnie (3,699,248); and R. G. Stoutmcycr ct aL 
SUMMARY OF THE INVENTION 15 (3,917,412). and showings of eye-tracking techniques 

Systems have been proposed for remotely viewing a include: C. L. Nork (3.379.885); K. ^ M^^ 
scerby means of a dos^-circuit television system or (3.^62,604); W^ S Holmes (3^07 988); T. N Com- 
the Hke Some of these prior art systems have included (3,712.716); and T. N. Corm^weet et al. 

automatic means for remotely controlling various pa- (3,724,932). ^ , . .^^^^^ u«i«,^o 
rameteis such as pointmg direction, focus, and the like. ^ ^.1", these pnor art showm^. ^^.^^J^^ 
of the remote sSsor or real-time transducer of the disclos^an miage display ^J^l^T^^^f. 
system thereby to effect some change in the scene 

producedonadisplayattheremotelocation. Attempts "^"^ZT^ enhance the reah^ of Ae 

Lve been madehi Uie past to coordinate the move- display viewed by the operator and to avoid conm^l 
* ^iTir ^XlzZl^^or.. «,;th 25 mstabiUties. motion sickness, and spatial disorientation 

men or control of the remote sensor with Ae move- • ^^^^^^ ^ ^ 

ment of tfie remote observer's head or ey«^ Tt^ high-speed ^omnent. both hehnet aSd eye mov^ 

sy8ten«ofthepnorart mlnSild be tracked to maintain hi^ resoUon on 

oftendisonentttoobserverorresdtma thelineof sight together with a wide fidd of view back, 
low resohition. T^ese and o^er disadvantages of Ae Beciise Homes uses only eyetrackmg and. in 

pnor art systems have made them largely mapphcaWe ^^^^ ^ ^ television 
for tasks of ^y complexity such as the pdotmg of high- ,^ ^^^y^ ^ ^^^^ are used to gcner- 

speed aircraft, particularly durmg the take off, iandmg. ^ high-resolution image on the Ime of sight on a 

and low-level operations hereof. degraded wide field of view, the apparatus of Hohnes 

2. Description of the Prior Art . ^ 35 thus suffers the disadvantages of the prior art that the 
Thepriorartdisclosesanumberofexamplesofhead- ^^.^ mvention overcomes, 

or hebnet-mounted display systems in which it is pro- 

posed to re-create on a display viewed by an observer a OBJECTS OF THE INVENTION 

scene picked up by a ronotely located sensor or real- u is thus a principal object of this invention to pro- 
time transducer such as a television camera or radar ^ ^ display system in which the visual display or 
apparatus. These prior art systems, namely those dis- presentation has high and low resohition areas that 
closed by J. H. (Ockey (U.S. Pat No. 2.7 1 1 .594); A. N. closely approximate eye resohition and which incorpo- 
Stanton (U.S. Pat No. 3.059,519); W. E, Bradley (U.S. servo-control means to keep the area of high 

Pat. No. 3.205.303 ); and F. H. S. Rossire (U.S. Pat No. resolution approximately centered on the viewer's line- 
3,614,314), have certain shnilarities witii the present 43 of.gjght (LOS) such that the visual characteristics of 
invention in that they have a closed-circuit television or display very nearly match the human eye to thereby 
the like viewmg system having means to present an avoid the degradation in the visual quality of the dis- 
nnage transduced by remote sensors to a helmet- pi^y systems in the prior art 

mounted display. Unlike the case in the present inven- jt is also an important object of this mvention to 
tion which em^doys both head and eye tracking tech- 59 provide a display system whose vkual quality closely 
niques and servo means to center substantially on the approximates the human eye such that realism of the 
line of sight an image having a high resolution portion display is enhanced. 

duplicating closely the visual characteristics of the Other and further objects of the invention will be- 
human eye; Hickey, Bradley, and Rossire. use a head come apparent firom the detailed description of the 
tracking technique and their displays present an image s5 invention given in the accompanying Specification and 
of substantially uniform resolution. The display viewed drawings. 

by the observer lacks, therefore, essential visual char- npcrpipnON OF THE DRAWINGS 

acteristics that largely prevents them firom attaming a DESCRIPTION OF THE DRAWINGS 

natural, realistic display image. Also, in that they do For the purposes of illustrating the invention, there is 
not use both head and eye tracking to control the line 60 shown in the drawings, the forms which are pr^ntly 
of sight, these prior art systems would be substantiaUy preferred, it ^ould be understood, however, that the 
unusable in high-speed vehicles such as, for example, invention is not necessarily limited to the precise ar- 
by the pilot of an aircraft for the landing and takeoff rangements and implementation here shown, 
phases of flight or for terrain avoidance, because of the FIG. 1 is a diagrammatic perspective view of an em- 
motion sickness and spatial disorientation they mduce. 65 bodiment of the hehnet-mounted display of higb-reso- 
Stanton. in addition to not teaching head and eye track- lutlon system of the invention; 
ing, provides no lowing of means to maintain the FIG. 2 is a diagrammatic illustration of an embodi- 
remote s^isor on the observer's line of sight ment of the system of the invention; 
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FIG. 3 fe a diagrammatic illustration of the electro- patent may be regenerated from a software program 
optical elements of a display embodied in the inven- translator as is weU known in the art. It is also known m 
tlonj this type of helmet-mounted display system to supenm- 

FIG. 4 is a plot of parameters of the human eye com- pose on the image bemg viewed on the LOS of the pilot 
pared with identical parameters of the display embod- 5 a reference symbol such as a gunsight reticle which the 
ied in the invention; pilot can align with a target for weapons delivery and 

FIG 5 is a diagrammatic illustration of an eye tracker the like. A furtiier conventional teaching of apparatus 
embodied in the invention; for generating symboUc images for the display is dk- 

FIG 6 a schematic diagram of tiie geometrical closed in the O. Wolfson ct aL patent, U.S. Pat No. 
relationships embodied in the invention. 10 3,885,095. for a Combined Head-Up Multis^sor Dis- 

FIG. 7 is a diagrammatic illustration of the field-of- play. As described in that patent, the symbolic display 
view of monocular and binocular embodiments of the source includes a solid-state read-only memory which 
invention- ^ programmed with the symbols that will be interposed 

FIG. 8A is a diagrammatic illustration of an analog of on the display. The memory is connected to a comput- 
a ftuther embodiment of the system of the invention; 15 ing circuit which generates signals supplying added 

FIG. 8B is a diagrammatic illustration of the imple- information to the symbols in accordance with input 
mentation of the embodiment of FIG. 8A; data from remote sensors. 

nC 9A is a front elevation of a conventional aircraft Helmet-mounted display 10 comprises means for 
mstrument panel; and presenting imagery generated by the sensor system 12 

FIG. 9B is a front elevation of Uic instrument panel of 20 and/or a computer (not shown) with an area of rela- 
FIG 9A when viewed through the display system em- tively high resolution of the image substantially on the 
bodied in HGS. 8A and 8B. operator's LOS and means for detecting the LOS and 

generating signals for maintaining the high resolution 
DESCRIFnON OF THE PREFERRED presented image approximately on the LOS. 

EMBODIMENTS 25 The image presenting means comprises suitable means 

Referring now to FIGS. 1-6, there is shown an illus- such as cathode ray tubes (CRTs) 26 and 28 for pro- 
trative embodiment of the invention in a hebnet- tecting images m accordance with signals generated 
mounted display for a pilot of a high^ecd aircraft It respectively by tiie wide FOV sensor 20 and tiie nwrow 
win be understood, of course, tiiat an aircraft environ- FOV sensor 22, suitable coUnnating and combmmg 
ment is given by way of example only since tiie system 30 optics 30, and a servoed beamsplitter 32, (As descnbed 
can be used in otiier applications. previously, tiic input to the CRTs can be generated by 

In aircraft applications, the sensor system 12 can be a computer or otiier suitable means.) As also descnbed 
located in a suitable position in tiie aircraft 16 such as previously, tiie FOV of sensor 20 is, for example, 25 
tiie nose 18 tiiereof. The sensor system comprises a degrees, and sensor 22 is, for pxample, 5 degrees. Prcf- 
wide field of view (FOV) sensor 20, preferably witii a 35 erably, also, tiie optics 30 comprise CRT lenses 34, 36; 
FOV of 25"; a narrow FOV sensor 22, preferably hav- folding mirrors 38, 40; dichroic nairrors 42, 44; foldmg 
ing a FOV of 5'; and a servo-driven tracking system 24, mirror 46; and lens 48. Beamsplitter 32 is angularly 
for aiming tiie sensors in a direction related to tiie adjusted relative to tiie operator's eye by suitable servo 
pilot's line-of-sight (LOS). For optimum performance, means 33 in response to error signals generated by an 
a high-speed servo system for tiie sensors is preferred. 40 eye-angle detector 50 to maintain the area of high 
Such a high-speed servo would have a slew rate of resolution of tiic image substantially on tiic operator's 
approximately 1000' per second maximum and an ac LOS. For optimum performance, a high-speed servo 
celeration capability of approximately 40,000' per se- system for tiie beamsplitter is preferred. Such a high- 
cond«. It wiU be understood, of course, tiiat tiie FOVs speed servo would have a slew rate of about 600 per 
of the sensors will be selected to suit tiie requirements 45 second maximum and an acceleration capability of 
and can vary ftom tiie values given. Sensors 20 and 22 • approximately 40.000 degrees per second*, 
can be of any suitable known types such as, for exam- CRTs suitable for use in tiie present invention are m 
pie television cameras or similar electro-optical appa- widespread commercial use and a fiiitiier description 
ratus and tiie like. As is known, tiie electro-optical tiiereof is believed not to serve a useful purpose and 
apparatus can be tiie type operating in any selected 30 wiU not be given. Typically, suitable CRTs have 800 
frMuency range of tiie electromagnetic spectrum and lines of resolution and versions producmg pictures m 
tiie inftared (IR) frequencies as weU as tiie "visual" black and white or in field sequential color are corn- 
frequencies can be utilized. mercially available and can be employed. 

The presentation input to display 10 can be provided In tiiis invention, dual sensors, one havmg. for cxam- 
by otiier means whose signal input can be coordinated 55 pie. a 25* FOV and one witii a 5» FOV. generate tiie 
^th or if desired, replace tiie input of tiic sensor sys- signal input to tiie CRTs 26, 28 to produce tiie image 
lem 12. As b known, tiie input to tiie display can also for tiic display. The picture projected by CRT 26 oper- 
be computer-generated imagery or tiie input signals atively associated witii tiie wide-FOV sensor 20 passes 
can be image information transduced by suitable tiirough collimating lens 34 and is reflected by mirror 
known pick-up means from a "storage" means such as, 60 38 to tiie partially reflective dichroic mirror 42 and is 
for example magnetic tape. Any known conventional tiien reflected to mirror 46, as perhaps best shown in 
system such as. for example, tiie one described and HG. 3. The picture projected by CRT 28 operatively 
explained in U.S. Pat No. 3,449.721, Graphical Dis- associated witii narrow-FOV sensors 22 is reflected by 
play System M L Dertouzos et al.. Inventors, can be mirror 40 and is reduced optically by lens 36 and passes 
us^ as tiie source of symbolic images for tiie display. 65 to tiie partially reflective dichroic mirror 44 and b tiicn 
One of tiie teachings of tiiat patent is a command pro- reflected to mirror 46. Dichroic mirror 44 is sized to be 
gram generator operating m real time in response to large enough to reflect tiie reduced narrow-FOV image 
Uiput data. The command program in tiie referenced and block tiie central portion of tiie wide-FOV image 



Page 7 (SAn, 12/07/2000, EAST Version: 1.01.0015) 



4,028,725 

5 6 

reflected off dichroic mirror 42. Using this arrange- are dependent on the angular position of the eye. The 
mcnt, the image incident on mirror 46 will be a com- pacing is controlled to the values at which the servoed 
bined image consisting of the high-resolution narrow- beamsplitter aligns the optical system axis parallel with 
FOV image which is inserted by mirror 44 into the the eye LOS. 

center of the wide-FOV image reflected by mirror 42. 5 Realignment of the servoed beamsplitter in response 
It win be understood, of course, that other known opti- to changes in the eye LOS indicated by the alignment 
cal means can be used to combine the images. This of the Purkinje images is effected by the output from 
combined image is reflected off mirror 46 through lens eye angle detector 50. The detector comprises a pair of 
48 to servoed beamsplitter 32 which reflects the com- suitable silicon quadrant IR or dual axis continuous 
bined hnage to the eye of the observer. Increasing the 10 position sensing photodiodes 56 and 58 operatively 
resohition on the eye LOS results in a better match associated with Pj and P4. respectively. Physical mter- 
betwecn the eye resolution and the display, as shown in ference between the two photodiodes is prevented by a 
FIG. 4. Both the eye and the display in this invention beamsplitter 60 which optically separates them. The 
have a high resolution central area accompanied by a first Purkinje image, P„ is two orders of magnitude 
lower resolution peripheral area. The actual resolution 15 brighter than the fourth image, P*, and is closer to the 
of the display in this mvention witii appropriate sensor eye axis. Thus, since Pj is approximately .100 times 
mputs is designed to be substantially equal 'to that of brighter than P4, the photodiode 56 operatively asso- 
the human eye. The images seen by the eye appear ciated with Pi can be selected such that its spectral 
normal and, m aircraft use, should eliminate pilot dis- response is not unduly mfluenced by the P4 image. The 
orientation or sickness. Preferably, a uniform 1:1 mag- 20 image P, is blocked so that it is not incident on tiie 
nification is used over the entire dual-resolution display photodiode 58 associated with P4 when the Pi photodi- 
to enhance the realism thereof. ode is nulled. Positioning of the servoed beamsplitter in 

Eye-angle detector 50 is utilized to generate the input response to the outputs of photodiodes 53, 58 is as 
signals to the servo-means of beamsplitter 32 to adjust follows: Assume that the eye is looking straight ahead 
it accordmgly such that the high-resolution area of the 25 and that the collimated IR beam is at an angle, A, with 
display is maintained substantially on the eye LOS of respect to the eye LOS. Now let the eye rotate through 
tiie operator. A number of techniques for determinmg some angle, 6, the Purkmje images may be laterally 
the eye angle are known, however, a technique lismg displaced relative to their original position and may 
harmless, low-power mvisible IR directed into the eye also change in spacing. Only the change in spacing is 
and imaging the reflections from within the eye is pre- 30 needed. The lateral motion, however, results in the 
ferred. Such technique is disclosed m U.S. Pat No. images movmg on the photodiodes. This motion results 
3,724,932, Eye Tracker and Method, to T. N. Com- in an error signal output to servo 33 which moves 
sweet ct al. The technique uses the first Puridnje nnage, beamsplitter 32 accordingly to keep image P, fixed on 
formed by the radiance reflected from the front surface photodiode 56. With die image of Pi fixed, any motion 
of tiie eye, together with the fourth Purkmje image 35 of image P4 on photodiode 58 represents a change of 
formed by radiance reflected from the rear surface of spacing and. therefore, an angular change indicates 
tfie eye's lens. These images change their relative spac- that the beamsplitter is not correctiy positioned. Mo- 
ing when the eye is rotated, yet remain fixed in relative tion of the image on photodiode 58 generates an error 
spacmg during translation of the eye position with re- signal which causes the serve to adjust the beamsplitter 
spect to the axis of the optical system. Thus, by moni- 40 such that the angle between eye LOS and the IR beam 
toring the position and spacing of the first and fourth once again equals A. 

Purkinje images, unambiguous eye LOS information In addition to tracking eye position, a helmet-posi- 
can be obtamed. tion detector 70 is utilized to monitor hehnet/or head 

In the implementation in the subject invention movement Any suitable known helmet-position detec- 
(FIGS. 3 and 5). a low-power beam from a suitable IR 45 tor which produces electrical output sig^ials as a result 
source 52 is directed to the operator's eye 54 via the of helmet angular displacement can be utilized. A rep- 
scrvoed beamsplitter 32 positioned in front of Ae eye. resentative example of such suitable tracking means is 
An IR-cmitting diode can be used as the radiation that taught by R. G. Stoutmeyer et al. m U.S. Pat. No. 
source. Such commercially available diodes provide 3.917,412. Advanced Hehnet Tracker Using Lateral 
radiance at approximately 0.9 microns, which is suffi- 50 Photodetection And Light-Emitting Diodes. In such 
cientiy removed from the 0.4 to 0.7 micron visual spec- system, at least a pair of suitable light-emitters 72 and 
tral region to avoki any interference with the visual 74 mounted on the hehnet are used in conjunction with 
display. It will be appreciated that, if the eye looked at least an associated pair of photodetectors 76 and 78 
directly at the IR source, the two Purkinje images will fixedly mounted fonrard of the observer on structure 
be superimposed. To prevent this possibility, the opti- 55 such as the aircraft cockpit In addition, a simple 
cal path for the displayed nnage is offeet from the IR known computer (not shown) is provided to process 
path by a fixed angle. Mamtammg the IR source offeet the outputs ftx>m the photodetectors, 
at this fixed angle relative to the eye LOS. automati- In operation, light emitted from emitter 72 is de- 
cally centers the displayed image on the eye LOS. tected by detectors 76, 78, whkh respectively measure 

Error detecting means in the eye angle detector 50 60 direction-cosines to emitter 72. Since the orientation of 
are provided for determining the position of the first the detectors is known and the direction-cosines from 
Purkinje image P„ formed by the front surface of the each detector to emitter 72 is measured, the plane 
eye and the fourth Purkinje image P4, formed by the including the point occupied by emitter 72 and detcc- 
rear surface of the eye lens. These images are spaced tors 76, 78 can be determined by mathematical analysis 
and oriented with respect to one another as a function 65 performed by the computer m a known manner. Like- 
of the off-axis position of the IR source relative to the wise, the plane contaming the points occupied by emit- 
eyc LOS. For a fixed off-axis IR source, the spacing ter 74 and the detectors can be determmed. By per- 
between the two Purkinje images and their orientation forming its programmed mathematical computations, 
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the computer describes and locates the orientation of 
the helmet relative to some reference axis which can be 
the longitudinal axis of the aircraft. 

It will be seen that the eye angle detection system 
acts to slave the beamsplitter 32 and, therefore, the 
center (or another predetermined area) of the display 
image on the eye LOS. The beamsplitter angles, which 
are related to eye angles, are measured by suitable 
known transducers (not shown) located on the servo 
drive mechanism 33 to provide necessary command 
and feedback functions, as is well known in the art. The 
Purkinje images can be moved, as described, by angu- 
lar movement of a scrvoed mirror or, alternately by 
other known means such as by the use of a matching 
pair of rotating Herschel wedge prisms. Further, the 
electrical signal output from the eye angle detection 
system and the electrical signal output from the helmet 
position detector system 70 are combined and are 
transmitted to the sensor system servo means 24 to also 
slave the sensor system 12 to the eye LOS. 

A common problem with conventional helmet- 
mounted displays is the ^smearing" of the image being 
viewed because of relative motion between the display 
and the eye such as would be caused by the helmet 
slipping, vibration, and the like. In this invention, hel- 
met slippage and head relative movement do not result 
in an angular error in either the pointing of the remote 
sensors or in the position of the displayed image that 
would cause smearing. This is due to the fact that hel- 
met slippage or other relative motion results in a hel- 
met angle change which is accompanied by an equal 
and opposite eye angle change with respect to the hel- 
met, see FIG. 6. It will be seen that the sum of the two 
changes, which provides the signal to drive the servo of 
the remote sensor 12, does not change. Therefore, the 
sensor pointing does not change. Although movement 
of the display image occurs because of the eye angle 
change the amount and direction of the change is ex- 
actly viiat is required to keep the displayed image 
centered on the eye LOS. In other words, in the normal 
situation, the sensor will point to the sum of the helmet 
angle and eye angle, ct¥p, and the display will be cen- 
tered on if the hehnet should slip through an angle 
of 5, the sensor pointing direction will be (a-5) + 
OfS) " (a+0) and both the display and the sensors 
will remain on the LOS (af+|3). 

It will be recognized that the instantaneous FOV can 
be significantly increased by incorporating two dis- 
plays, one for each eye, in the observer's helmet such 
that binocular capabilities will be provided. In a 
binocular system, the high resolution area 62 of the 
display is preferably oS^et 64 from the center of the 
low resolution area of the display, as shown in the 
upper portion of FIG. 7. When both eyes focus on an 
object, the resultmg combined display, Ulustrated in the 
bottom portion of FIG. 7, with an ofeet 64 of approxi- 
mately 5 degrees, has a horizontal instantaneous FOV 
68 of 40*, assuming the narrow FOV 62 to be 5** and the 
wide FOV 66 to be 25** for both a monocular and a 
binocular system. 

In operation, assuming the invention to be embodied 
in a helmet-mounted display being used by the pilot of 
an aircraft, the pilot looks at a target or other area of 
interest. The IR source 52 of the display system 10 
directs a beam of IR radiance through beamsplitter 32 
mto the pilot's eye 54. The first and fourth Purkinje 
images are passed to eye angle detector 50, which de- 
tects the alignment of the eye with respect to the IR 
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source. Appropriate error signals are generated to 
drive servo 33 to adjust beamsplitter 32 to re-align the 
IR source with respect to the eye. This action also 
aligns the display with the eye LOS. The beamsplitter 

5 angle thus determines eye angle. Concurrently, light 
from emitters 72, 74 is monitored by detectors 76, 78 
of the helmet position detector system 70 and the out- 
put signals therefrom are summed with the output sig- 
nals from eye angle detector 50 and are used to slave 

10 the servos 24 of the remote sensors 20, 22 to align them 
with the LOS of the pilot. The output signals from the 
remote sensors are passed to the CRTs 26 and 28, 
which project imagery of the scene viewed by the sen- 
sors through optics 30 and the beamsplitter 32 to thus 

IS present to the pilot*s eye an image duplicating that 
which would appear on the LOS. 

The scene imaged on the display will appear directly 
in front of the pilot's eyes and will shift with movement 
of his head and eyes. This factor, coupled with the high 

20 resolution center of the displays on the LOS, and the 
1:1 magnification of the system, will impart to the pilot 
a feeling of realism. The remote sensors can be 
mounted in the aircraft in positions other than in the 
nose. Two or more sensor systems can be used and can 

25 be located on the aircraft such that obstructions m the 
line of sight such as would be caused by the wings or 
other structure can be prevented merely by automati- 
cally switching to seraors having an unobstructed view. 
The vision system embodied in this invention has the 

30 capability of producing image displays of high visual 
quality. It will be appreciated that a multi-sensor design 
also has stereoscopic capabilities for achieving the 
imaging of views in three dimensions. In such embodi- 
ment, a binocular helmet-mounted display would be 

35 provided and two pairs of remote sensors, such as TV 
cameras, would be used to pick up different views of 
the remote scene for use with the display for each of 
the observer's eyes. Stereoscopic systems are well 
known and it is not believed that any useful purpose 

40 will be served in a further description thereof. It is also 
known in such systems to produce images in color and 
a field sequential cobr television system with a rotating 
color wheel for each cathode ray tube is entirely practi- 
cal. 

45 In an alternate embodiment, the sensors 20, 22 can 
be located in an aircraft at the position normally occu- 
pied by the pilot's head. An operator on the ground can 
be provided with suitable known remote controls for 
the aircraft and the communications Imk 14 between 
50 the aircraft sensors and the operator's display can be by 
means of radio. Thus, in remotely controlling the air- 
craft from the groimd, the operator will see exactly the 
view he would have if he were actually present in the 
cockpit of the aircraft. Other uses for an embodiment 
55 of this nature are for simulators for flight training, re- 
mote manipulators, for driving a tank, and the like. 

Telescopic vision can be obtained in this invention by 
displaying the signal output from the narrow FOV sen- 
sor 22 on the CRT 26 which normally displays scenes 
60 from the wide FOV sensor 20. The output from the 
wide FOV sensor normally used with CRT 26 will be 
inhibited, of course, in this case. This technique will 
yield approximately a 5:1 magnification. 

As in conventional helmet-mounted displays, the 
display system embodied in the subject invention can 
display computer-generated imagery (CGI). The image 
can be displayed in accordance with known prior art 
techniques or, advantages can be taken of the unique 
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capabilities of the subject invention to create images said light signals of the field of view of the observer 

that appear fixed in space. A mode of image presenta- by directing light carrying said signals into at least 

tion which closely approximates an aircraft cockpit one eye of the observer with the area of the in- 

display can be readily implemented with the present serted image havmg a predetermined relationship 

system. An analogy of the implementation of this type 5 with said line of sig^t; 

of display system in which the CGI instruments appear monitoring means operatively associated with said 

to be fixed to the aircraft is shown in FIG. 8A, As hehnet for measuring angular displacement thereof 

shown in nc. 8B in the actual implementation of the with respect to said reference axis and for produc- 

cmbodimcnt, a computer 80 and an alphanumeric gen- ing control signals indicative of such angular dis- 

erator 82 of suitable known types are used instead of 10 placement; 

the dual-FOV TV camera 84 to generate display tnfor- monitoring means operatively associated with said 

mation which appears to be fixed on the instrument display means for measuring angular displacement 

panel. To see a specific instniment, the pilot merely of said optical superimposing means with respect to 

looks in the direction in which the instrument is "lo- said eye line of sight and for producing control 

cated". To avoid superposition of images when both 15 signals mdicative of such angular displacement; 

CX31 and the sensing system 12 are being used concur- means responsive to ssad control signals from said 

rently. as is well known in the art. the computer can eye line of sight monitoring means for adjusting the 

automatically choose between the sensor signals and orientaidon of said optical supernnpcwmg means 

the CGI signals. Thb type of display can be applied such that the orientation of said light information 

advantageously to the instrument panel 86 in the cock- 20 signals viewed by the observer remains substan- 

pit (not shown) of a highly maneuverablc — "high- tially constant with respect to said eye line of sight; 

gravity" (high-g) aircraft. In a typical high-^ cockpit, and 

an articulatfaig seat (not shown) is used to alleviate the means responsive to the control signals firom both 

efifect of gravity on the pilot The area nonnally con- said eye line of sight monitoring means and said 

taining instruments and displays is significantly reduced 25 hehnet angle monitoring means for adjusting the 

by the space 88 that has to be provided to accommo- angular orientation of said remote visual infonna- 

date the pilot's lep when in the supinated position tion source such that the angular orientation 

(FIG. 9A). As illustrated in FIG. 9B, thb space can be thereof remains substantially constant with respect 

recovered for display use by locating the images 90 of to said line of sight 

the computer-generated displays in that area. 30 2. The high-resolution vision system as defined in 

Although shown and described m what is believed to claim 1 wherein the angularly adjustable optical means 

be the most practical and preferred embodiments, it is is a beamsplitter and wherein the angular adjustment 

apparent that departure from the specific process and thereof is by servo means responsive to the control 

apparatus described will sugg^ themselves to those signals from the line of sight monitoring means. 

skiUed in the art and may be made without departing 35 3- The high-resolution vision system as defined in 

from the spirit and scope of the bvention. I, therefore, claim 1 wherein the angular orientation of the remote 

do not wish to restrict myself to the particular imple- visual information source with respect to the predeter- 

mentation illustrated and described, but deare to avail mined reference axis is the algebraic sum of the hehnet 

myself of all modifications that may fall withm the angle and the eye angle. 

scope of the appended claims. 40 4. The high-resolution vision system as defined in 

Having thus described my invention, what I clann is: clami 1 wherein the apparatus on the hehnet mounts 

1. A high-resolution vision system for an observer eye-trackingdisplaymeansfor each eye of the observer 

having a field of view related to a predetermined refer- whereby binocular vision is attamed. 

ence axis compriang: 5. The hi^-resohition vision system as defined m 
a hehnet worn on the head of the c*scrvcr; 45 claim 1 wherein the remote visual information pick-up 

apparatus on said hehnet for moimting eye-tracking sensors are television cameras and wherein the light 

display means havhig an image presentation which projecting means are cathode ray tubes, 

is slaved to the eye line of sight of the observer, 6. The high-resolution vision system as defined in 

a remote source of visual mformation including at cUum 5 wherein the remote pick-up sensors arc respon- 

least a first and a second pick-up sensor, 50 sive to mfrared radiation^ 
servo means for adjusting the orientation of said 7. The high-resohition vision system as defiried in 
remote source with respect to said reference axis, claun 5 wherein the first remote sensor is a television 
the angular orientiEUion thereof with respect to said camera having a narrow field of view and the first light- 
axis being related to the angular orientation of said projecting means associated therewith is a cathode ray 
helmet and the eye angle of said observer, 55 tube and the second remote sensor b a television cam- 
communications means between said remote source era having a wide field of view and the second light- 
and said hehnet-mounted display means for trans- projecting means associated therewith is a cathode ray 
mitting visual information signab and control sig- tube, whcrdn said second sensor and said first light- 
nab therebetween; projecting means are inhibited and the light-informa- 
at least a first and a second light projecting means in 60 tion signals from said first narrow field of view remote 
said display means for producmg light-information sensor b processed through said second light-project- 
signab in response to vbual information derived ing means whereby a magnification of the display im- 
£rom said remote source; ages b provided, 
means inserting said light signab from said first pro- 8. The high-resolution system as defined in claim 5 
jecting means mto a selected area of said tight 65 whereb the first pick-up sensor has a narrow field of 
signab from said second light projecting means; view and the second pick-up sensor has a wide field of 
angulariy adjustable optical means in said dbplay view such that, when the li^ signab from the cathode 
means for superimposing the combined image of ray tube associated with said first sensor are mserted 
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into the light signals from the cathode ray tube asso- bined image s on the center of the eye tine of sight of 

dated with said second sensor, the combined image observer. 

thereof superhnposed on the field of view of the ob- 10. The high-resolution vision system as defined in 

server will have an area of h^ reaolution related to the claim 8 wherem the first pick-up sensor has a field of 

eye line of sight of the observer. 5 view of five degrees and the second pick-up sensor has 

9. The high-resolution vision system as defined in a field of view of 2S\ 

claim 8 wherein the high-rcsohition area of the com- « * • • • 
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